Skip to content

gh-158895: Teach libregrtest to output github job summaries - #158896

Draft
cmaloney wants to merge 28 commits into
python:mainfrom
cmaloney:regrtest-gha-summary
Draft

cmaloney wants to merge 28 commits into
python:mainfrom
cmaloney:regrtest-gha-summary

Conversation

@cmaloney

@cmaloney cmaloney commented Oct 6, 2026 •

Copy link
Copy Markdown
Contributor

Goal is to make it faster to triage individual test failures while keeping the full existing regrtest fidelity. Fairly minimal integration to hopefully save some human eyeball time.

Setup so only the test summary process should output the summary, subprocesses have the env var which will cause output unset.

Goal is to make it faster to triage individual test failures while
keeping the full existing regrtest fidelity. Fairly minimal integration
to hopefully save some human eyeball time.

Setup so only the test summary process should output the summary,
subprocesses have the env var which will cause output unset.
@bedevere-app bedevere-app Bot added the type-feature A feature request or enhancement label Oct 6, 2026
@hugovk

hugovk commented Oct 6, 2026

Copy link
Copy Markdown
Member

Can you temporarily trigger a test failure so we can see it in action?

@cmaloney

cmaloney commented Oct 6, 2026

Copy link
Copy Markdown
Contributor Author

Yea, planning to pass + fail + iterate on failure to get it pretty then get back to passing and mark as ready for review :)

Comment thread Lib/test/libregrtest/main.py Outdated
@cmaloney cmaloney changed the title gh-158895: Teach librertest to output github job summaries gh-158895: Teach libregrtest to output github job summaries Oct 6, 2026
@edvilme

edvilme commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

I think having a screenshot in the description could help out a ton (I know that is the reason for the intentional failures, but may be easier to glance and get more exposure)

cmaloney and others added 2 commits October 12, 2026 15:39
Locate annotations at the last traceback frame in a test file instead of
mapping each test to its file. Pass annotations to workers in RunTests,
like use_junit, so tests which run regrtest don't inherit
GITHUB_STEP_SUMMARY. Shrink the tests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Fall back to the first traceback frame (the test) instead of passing the
test module file.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type-feature A feature request or enhancement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants